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Abstract 

o' 

^ . These notes derive a number of technical results on nonlinear contraction theory, a com- 

paratively recent tool for system stability analysis. In particular, they provide new results 
on the preservation of contraction through system combinations, a property of interest in 
modelling biological systems. 
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1 Introduction 



> 



Nonlinear contraction theory [Lohmiller and Slotine, 1998] is a comparatively re- 
cent tool for system stability analysis. These notes derive a number of technical 



results motivated by the theory. In particular, they provide new results on the preser- 
vation of contraction thro 
elling biological systems. 



03 ■ vation of contraction through system combinations, a property of interest in mod- 



Section 2 analyzes the preservation of contraction through generalized negative 
feedback between contracting systems. Section 3 describes a new system combina- 
tion, centralized contraction, which also preserves contraction by aggregation. Sec- 
tion 4 uses standard results from computer science to simplify the general structure 
of arbitrary system combinations, and in particular to exploit intrinsic hierarchi- 
cal properties. Section 5 discusses some applications to nonlinear attractors, while 
section 6 describes the estimation of the successive derivatives of a vector using 
composite variables. 
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2 Negative feedback 



This section analyzes feedback connections which automatically give rise to con- 
traction with regards to a predefined metric. 

Consider two contracting systems, of possibly different dimensions and metrics, 
and connect them in feedback, in such a way that the overall virtual dynamics is of 
the form 

±(fox\_( F i -G(z,t)B\ / bz x 
dt \Sz 2 ) ~ \G{m,t) T A T F 2 ){sz 2 
with A, B two square matrices. The overall system is contracting if 

(1) A and B are symmetric positive definite, and 

(2) there exists p > such that 
A + A.Fi + Fi T A< -pA 
B + B.F 2 + F 2 T B < -0B 

Indeed, we can define the metric 




We have 

— (5z T M5z) = MF + F r M + M 
at 

where the matrix MF is of the form, 



MF 



AFi -AG(z,t)B 
BG(z, t) T A B.F 2 



Thus 

-(5z T M5z) = 5z T 
dt 



^A + AFi + F^A 



V 



B + BF 2 + F 2 T B 



5z < -p5z T M5z 



by hypothesis, which implies that 5z T M.5z tends exponentially to zero. Since M is 
positive definite, this in turn implies that 5z T 5z tends exponentially to zero. 



3 Centralized contraction 



We extend here the class of combinations of contracting systems described in 
[Lohmiller and Slotine, 1998]. From a practical point of view, the condition given 
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for feedback combinations may be hard to deal with, whereas hierarchical combi- 
nations are much simpler but not general enough. It is therefore of interest to find a 
combination having a strong expressiveness together with an automatic guarantee 
of contraction. 



An almost hierarchical feedback combination. The basic idea lies in the fol- 
lowing remark. When looking at the combination depicted in figure 3, the loop 
between F\ and F 2 seems to be illusory, as the domain and co-domain in F 2 are 
disjoint. Let's try to formalize this idea. 

We consider two contracting system connecting in feedback in such a way that the 
second system can be split into z^ and z\ so to write 



d 
di 



0Z 1 

5z\ 



I 



Fx d 
F* 1 F* 2 
G 2 F 2 , 1 F 22 



0Z\ 

Szl 



bz\ J 



Then, a following our idea that this almost represents a hierarchical combination, 
we apply the metric 
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This says that, as long as Gi and G2 are bounded, they are negligible. However, 
we have no more guarantee on the contraction of F 2 as the matrix of feedback F2 2 
and F 2 , 1 have been perturbed by e. 

This tells us that we have to restrict this intuition to a particular kind of feedback 
within F 2 . 



3.1 Orientable systems 

The first step is to master the metric used in each local feedback. Indeed, as in the 
case of feedback combination, to apply the combination recursively, we need some 
guarantees of non interference between the metric. Then idea is to require that the 
metric use for each combination only acts on the peripheral system and not on the 
centralizer. This leads to the notion of orientable system. 

Definition 1 A combination between two systems is said to be orientable if a metric 
that makes the generalized Jacobian negative definite can be written 



Small gain. Consider two contracting systems, of possibly different dimensions 
and metrics, and connect them in feedback, in such a way that the overall virtual 
dynamics is of the form 



with A, B two square matrices. Note that in this form, A and B must have the 
same dimension. 

Assume now that A and B satisfy 

• B is invertible 

• AB -1 is constant and symmetric positive definite 
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We can then define the metric 




which can be rewritten M = © T © with 

Vab^ o 







I 



Using the fact that 

Vab x b = (VaF 1 )-^ 

we have 

v/AB^F^v/AB -1 )- 1 v / AF t BG(z, t) 
G(z,t) T ( v / AB _T B) T 

Applying a standard result for small gain feedback (see [Slotine, 2003]), we can 
conclude on the contraction of the system if v / AB~ 1 Fi(v / AB~ 1 ) -1 is negative 
definite and the following inequality holds 



a 2 (v / AB ZT BG(z,t)) < A((VAB^ 1 F 1 ( VAB- 1 )- 1 ) s )A((F 2 ) s ) (1) 



We can conclude that this system is an orientable scaling-robust system. 

Note that the above assumptions on A and B are verified in the common case that 
A is constant and symmetric positive definite and B = AI with constant A > 0. 



Negative feedback. In the same way, for a system of the form 

£ (SzA _ I Fx -BG(z,*)\ / 5 Zl 
dt \S Z2 ) ~ \G(z,tf A T F 2 ){sz 2 

we can construct a orientable metric such that the system is contracting if V AB~ 1 F 1 (V AB -1 ) -1 
is negative definite. 

3.2 Orientable scaling-robust systems 

Definition 2 A combination between two systems is said to be orientable scaling- 

(l 

robust if transforming the system by the metric D e = \ | (e > 0) leads to an 

I el 
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orientable combination with metric 




We further require that M € -> 0. 
Remark 3 The definition above says that the dynamics 



d_ 

dt 

are orientable for all e. 



<5x 2 




Small gain and negative feedback. Let us come back to the two previous exam- 



ples. It is clear that applying the metric D e 
contracting system with metric 

M f = 




for e > leads to another 




So an orientable small gain (resp. negative feedback) is automatically scaling- 
robust. 



3.3 Centralized contraction 



Assume that we have, as in figure 3.3, n systems connecting to a particular system 
called the center in such a way that every connection to the center is orientable and 
scaling-robust. Assume also that the connection between the different peripheral 
systems is hierarchical. 



That kind of system can be rewritten 
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Fig. 2. A centralized combination of contracting systems 
For that particular virtual system, let us use the metric 
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which leads to the system 
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Since all the couple (F/, F?) are assumed to be orientable scaling-robust, for any 
small e, there is a constant metric M such that the symmetric part of the generalized 
Jacobian can be written, when e tends to zero, as 



fH 6 
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where the matrices 

'Hi K ; 
K KT C 

are all negative definite. 
Applying a basic result of matrix analysis thus yields the condition 

C <J2 K^Hr^Ki 

i 

which is equivalent to 

^A(K? : H i r 1 K i C- 1 )<l 

i 

A sufficient condition is thus 

^(KO^CHt)- 1 < A(C) 

i 

or even the less general but easier to verify inequality 

]Ta(Ki) 2 < A(C)mmA(Hi) 

i 

We call this case centralized contraction. 
3.4 Going further 

The structure of centralized contraction is a general scheme that can be extended to 
more complex structures. We present here two basic extensions. 
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Multiple layers We can apply the result of centralized contraction even if the pe- 
ripheral system is composed of different layers. For example, the system described 
in figure 3 is automatically contracting providing that the red connections are ori- 
entable scaling robust. 




Fig. 3. Centralized contraction for multiple layers 



Multiple centers In biological systems, it is often of interest to consider a cen- 
tralizer which is composed of multiple systems. In that case, the contraction can 
be guaranteed if all connections to the center considered as a whole are orientable 
scaling robust. 



4 Strongly connected components 

In computational neuroscience as in many biological fields, we have to deals with 
large systems. Here we exploit a standard algorithm from computer science [Knuth, 1997] 
to decompose a large system into sub-systems, in a such way that the contraction of 
the overall system can be deduced from the contraction of the smaller sub-systems. 

Definition 4 A strongly connected component of a directed graph G = (V, E) is 
a maximal set of vertices U dV such that for all u,v G U, u is reachable from v 
and v is reachable from u. 

Proposition 5 Any directed graph is a union of strongly connected components 
plus edges to join the components together. 

Thus, we are able to distinguish between micro-systems which are connected in 
feedback combination or not. Indeed, we can state the proposition: 
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Proposition 6 Two sub-systems of large systems are in feedback combination iff 
those two systems belongs to the same strongly connected component. 

Let us now describe the algorithm to compute such a decomposition. 



Algorithm. Strongly _connected_components(G) 

(1) Use the Depth-First-Search (DFS) algorithm to compute f[U] the finishing 
time of u 

(2) Compute G T = (V, E) where E T = {(u, v)\(v, u) G E} 

(3) Execute DFS on G T by grabbing vertices in the order of decreasing f[u] as 
computed in step 1 . 

(4) Output the vertices of each tree in the depth-first forest of step 3. as a separate 
strongly connected component 



Complexity. This algorithm runs twice the time of DFS (G) which is €> ( | + 1 .E7| ) 




Fig. 4. The strongly connected components of a large system 
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4. 1 Topological sort of graph 

If the system consists of a directed acyclic graph (DAG), we can compute the topo- 
logical sort of this graph in order to have its hierarchical combination. 



Algorithm. Topological _sort(G) 

(1) Call DFS(G) to compute f[u], the finishing time of u 

(2) As each vertices is finished, put it into the front of a linked list 

(3) Return the linked list of vertices 



Complexity. Since DFS(G) takes 0(| V| + \E\) and insertion into linked list cost 
9(1) for each vertex, topological sort costs only 0(| V| + \E\). 



4.2 Filtering large systems 

Once we have computed the strongly connected components of the large system 
G, we can consider the graph G' = (V, E') consisting of the strongly connected 
components of G as vertices and E' = {(Ci, C 2 )|3m 6 C x , v G C 2 (u, v) G E}. 

Proposition 7 G' is a directed acyclic graph. 



Thus we can compute the topological sort of G' which gives rise to the hierarchical 
structure of the large system G. 




Fig. 5. The topological sort of the strongly connected components generated in figure 1. 
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Using the basic result on contraction of hierarchies [Lohmiller and Slotine, 1998], 
this implies that in order to show that a large system is contracting, we only have 
to show that each strongly connected component of the system is contracting, and 
that the couplings are bounded. 



5 Study of time varying hyper-curved attractors 

5. 1 Line attractor 

Consider a system x = /(x) contracting in a constant metric M. Then, the system 



will be called a line attractor as x tends exponentially towards x satisfying f (x ) = 



5.2 Time varying hyper-curved attractor 

Consider a system x = h(x, t) and suppose that there exists an explicit metric in 
which the system can be rewritten : 



I ±i = s(zi,t) 

[z 2 = f(z a ,t) + g(zi,t) 

with ^-(z 2 , t) uniformly negative definite. 

Then the system is said to be a time varying hyper-curved attractor as it tends to 



This system is contracting as J^(y, t) = ^(z 2 , t) is uniformly negative definite. 
So y tends exponentially to some /?(zi, t). As z 2 (£) is another particular solution, 
we know from partial contraction that z 2 (i) tends to the same /3(zi, t). □ 





Define the virtual system 



y = f(y,t) + g(zi,t) 
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Remark To know if hypothesis above are true given a system (with hi and h 2 
assumed to be C 2 ) 



d / zi \ / hi(zi,z 2 ) 



dt 



z 2 / \h 2 (zi,z 2 ] 



we only have to check that 



— — (zi,z 2 ) = (zi,z 2 ) = 

az 2 oziz 2 

Then, from Schwarz theorem, we know that two other equations are true 

(zi,z 2 )=0 (zi,z 2 ) = 

az 2 zi oz 2 zi 

and so the system can be rewritten in the required form. 
Example Consider the system 

x = -x + f(s) 

where the s/s are scalars. This system is an attractor with stable points (sj, f (si)). 
6 Composite variables 

6.1 Estimation of the successive derivatives of a vector 



We show how to compute the n successive derivatives of a given vector only by 
assuming that the (n + l) th derivative of the vector x is zero. 

Let Xj be the estimation of the i th derivative of x. We define each x^ associated 
composite variable. 

Xj — Xj -T" 0!jX 



and define the system : 
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X = JX 



With X = (xi, . . . , x n ) 



T and 



—Oil 1 . 



\ 



1 



1 



J 



1 . 



. 1 



\-a n 



0/ 



Let us rewrite the system in X: 



X = J (X - Y) 



with Y = (x, 0, . . . , 0) T . It is clear that the system is contracting iff the companion 
matrix J satisfies J T M + M J < for some metric M. 

Now, assuming that the system is contracting, it is easy to see that Xj = Xj, Vi is 
the unique solution of the system. Indeed, 



So, if the system is contracting, we are sure to converge to the right successive 
derivatives exponentially. 

Note that we can check the contraction of the system above using the Routh- 
Hurwitz criterion. 



6.2 Extension 

We can now analyze the case where the (n + \) th derivative of the vector x is a 
nonlinear function of x, x, . . ., that is x n+ i = /(x, xi, . . . , x n ). We just have to 
replace 



X=(x 2 ,..., 



x n ,0) T = J(0,x 2) ... 



x n ) T = J(X-Y) 



X = JX by X = JX+(0, ...,0,/(x,x 



Xn)f 
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The Jacobian of the system is 



J P.X 



ext. 



—a.\ 1 . 

1 
1 
1 . 
. 1 

\ — a _|_ _g^L 9 J 

\ n flxi 9x2 ' ' ' 9x n 



Note that the result that a n must be greater than 4f- was obtained in [Slotine, 2003] 
in the particular case where / corresponds to a Van der Pol oscillator. In that case 
J£ were all null except for = 1, and thus the condition was only a n > 1 
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Fig. 6. An estimation of a sinusoidal displacement 



Example We compute the velocity and acceleration of the displacement 1 cos (wox) 
using the differential equation 

dx 

— + 5x + 10000 x = 
at 

The result can be seen in figure 6 (we have shifted the estimated curves to facilitate 
the analysis), where we have used the values a\ = 5000 and a 2 = 2000. 



6.3 Estimation of velocity and acceleration using neural net 



Composite variables can be used estimate the velocity and the acceleration of a 
target given its position using a "neural network", with potential application in 
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Fig. 7. An estimation of velocity and acceleration of a parabolic trajectory 
modelling prediction. 

As seen in (6.1), assuming that the acceleration of the target is constant (ie. A = 0), 
we can compute the estimation of velocity and acceleration (resp. V and A) using 
only the position of the target X. For that, we introduce two composite variables 
V = V + aX and A = A + /5X computed by the system : 

V=-aV + A=-aV + (/3- a 2 )X + A 
A=-/3V = -/3V-/3 aX 

We thus obtain a classical neural network : 
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This network is contracting from section (6.1) and hierarchical analysis. 



Example A simulation of this system is presented in figure 7. The small dis- 
crepancy between estimated and theoretical values is due to the use of the "neural 
network". 
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Fig. 8. Converging beyond the scope of the system 

References 



[Knuth, 1997] Knuth, D. (1997). The Art of Computer Programming, 3rd Ed. Addison- 
Wesley. 

[Lohmiller and Slotine, 1998] Lohmiller, W. and Slotine, J. (1998). Contraction analysis 
for nonlinear systems. Automatica, 34(6):683-696. 

[Slotine, 2003] Slotine, J. (2003). Modular stability tools for distibuted computation and 
control. Journal of Adaptive Control and Signal Processing, 17(6):397-416. 



17 



